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Description 

Background of the Invention 

[0001 J The present invention relates to a classification 
and examination device of particles in fluids and, in par- 
ticular, relates to a classification and examination device 
which is suitable for such as an automatic classification 
and examination of sediments in urine and an automatic 
classification and examination of blood corpuscles in 
blood. 

[0002] When an examination engineer performs an 
examination visually on particles in fluid, for example, 
on sediment components in urine, the urine which is the 
object for the examination is centrifuged and precipitat- 
ed sediments are dripped onto a slide glass. Then if nec- 
essary after coloring the sediments on the slide glass, 
a specimen is prepared and the examination engineer 
observes the specimen visually through a microscope. 
[0003] Other than the above conventional method in 
which an examination engineer performs an examina- 
tion visually on the sediment components in urine, de- 
vices which automate these examinations are proposed 
in which particles are flowed in a flow cell while being 
suspended in liquid and optically analyzed. 
[0004] For example, JP-B-3-52573(1 991), which cor- 
responds to U. S. Patent No. 4,338,024, discloses a par- 
ticle analysis device in which a fluid specimen is passed 
through a fluid passage having a specific configuration 
so as to confine particles in the specimen in an extented 
image taking area and to produce still images thereof. 
With this particle analysis device a shape analysis of the 
particles is possible through an image analysis of the 
still images which allows an automatic classification of 
sediments in urine with regard to the sediment shape. 
[0005] JP-B-3-41 783(1 991 ) discloses a conventional 
particle classification and display device in which after 
taking in images of particles in fluid, a predetermined 
image processing is performed thereon, and in such im- 
age processing only the particle portions are cut out 
from the entire image for display purpose such that the 
particles could not be identified automatically with the 
image processing. 

[0006] Further, J P-A-3-1 00876(1 991) discloses a de- 
vice having further advanced image processing function 
in which edge detection of particle images and cutting 
out of the particle image portions from the entire image 
are performed, however identification of the particles 
still had to be performed manually. 
[0007] Still further, JP-A-60-38653(1 985), which cor- 
responds to U. S. Patent Nos. 4,393,466 and 4,61 2,61 4, 
discloses a particle analysis method in fluid specimen 
in which images of particles are displayed in a predeter- 
mined order. With this particle analyzing method, the im- 
ages of the particles are displayed in an ordered array 
by classes of visually discernible characteristics and 
thus the particle images are displayed in an order of size 
and color thereof. The method of JP-A-60-38653(1 985) 



requires a user operator to examine and confirm the dis- 
played screen image, and no automatic classification 
function is included, such that the particles are grouped 
according to particular parameters such as size of the 

s particles and are displayed, which is however insuffi- 
cient even as a supplementing function for further de- 
tailed reclassification afterward by the user operator. 
[0008] In the method disclosed in JP-B-3-52573 
(1991), the storage of the images and display thereof 

10 with regard to urine of healthy persons are performed 
comparatively easy, because the sediment components 
in the urine are extremely limited. However, in contrast 
to the urine of healthy persons, the urine of non-healthy 
persons contains a variety of sediment components 

15 such as non-crystalline salts, mucous threads, erythro- 
cytes and leucocytes in high concentration and charac- 
teristics of these component particles, for example rang- 
es of their shape and size, overlap each other. However, 
the method disclosed in JP-B-3-52573(1 991 ) shows an 

20 enough function of screening urine of non-healthy per- 
sons from urine of healthy persons, but an accurate 
analysis on specimens containing a variety of compo- 
nent particles such as non-crystalline salts, mucous 
threads, erythrocytes and leucocytes in high concentra- 

25 tion could not be realized. 

[0009] Further, when a specimen containing a variety 
of components in high concentration is analyzed by 
making use of the method disclosed in JP-A-60-38653 
(1 985), the component particles are displayed in an or- 

30 der such as size and color, therefore particles belonging 
to different types are displayed at the same time. For 
example, when the component particles are displayed 
in an order of size, leucocytes and erythrocytes are dis- 
played on a screen at the same time in a mixed manner, 

35 because the size ranges of leucocytes and erythrocytes 
overlap each other. Further, when the component parti- 
cles are displayed in an order of color, glassy casts and 
mucous threads are displayed on the screen at the 
same time in a mixed manner, because the colors of 

40 glassy casts and mucous threads are similar each other. 
[0010] Further, in the method disclosed in JP-A- 
60-38653(1 985), images of all of the particles appeared 
are displayed on the screen. For this reason, as the 
urine of non-healthy persons contains a great many of 

^5 sediment components as explained above, it takes a 
long time for displaying alt of the particle images and for 
judging the respective displayed particle images, more- 
over it is possible to miss sediment components (for ex- 
ample, heteromorphic cell and cancer cell) which ap- 

50 pear infrequently but have a significant implication for 
diagnosis. Still further, it is required to have memory ca- 
pacity to store all of the images of the appeared sedi- 
ments such that it is quite difficult to store data of many 
specimens at the same time. 

55 [0011] In the conventional particle classification de- 
vice, even though a classification of particles according 
to such as particle size can be displayed, classification 
of the particles with regard to types and characteristics 
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has to be performed by a user operator over the entire 
particles which requires a significant man-hour and 
time, and is problematic. 

[0012] As explained above, with the conventional 
methods it was difficult to perform an accurate and fast 5 
urine sediment analysis on specimens containing a va- 
riety of components in high concentration. 
[0013] US-A-4 612 614 discloses a device with the 
features of the preamble of claim 1 . 

10 

Summary of the Invention 

[001 4] An object of the present invention is to resolve 
the conventional problem and to provide a particle clas- 
sification and examination device wh ich detects charac- * 5 
teristic parameters of the respective particles such as 
area, circumferential length, maximum X axis cordinate, 
minimum X axis coordinate, maximum Y axis coordi- 
nate, minimum Y axis coordinate, X axis projection 
length, Y axis projection length, red color concentration, 20 
green color concentration and blue color concentration, 
and automatically determines the types of the respec- 
tive particles to thereby eliminate man-hour for the par- 
ticle classification, stores and displays the classification 
results and the particle images altogether and permits 25 
alternation of the characteristic parameters, preparation 
of learning data and relearning to thereby improve time 
to time the classification accuracy. 
[0015] Another object of the present is to realize a 
classification and examination device of particles in fluid . 30 
which can automatically perform an accurate and fast 
component particle analysis even for a specimen con- 
taining a variety of components in high concentration. 
[001 6] For achieving the above objects of the present 
invention, the particle classification and examination de- 35 
vice according to the present invention is constituted as 
defined in present claim 1 . 

[001 7] According to the constitution of the present in- 
vention, the image processing unit takes in colored im- 
ages of the particles, breaks down the colored particle *o 
images depending on colors, generates at least one bi- 
nary coded image, determines characteristic parame- 
ters such as area and average concentration corre- 
sponding to the particle portions in the binary coded im- 
age and automatically identifies the respective particles 45 
based on their characteristic parameters so that con- 
ventionally required man-hour as well as waiting neces- 
sity of a user operator's judgement input are avoided. 
[0018] Further, since the particle images, the classifi- 
cation results and the related data with the specimen so 
are altogether stored and displayed, the properness of 
the classification results is very understandable at the 
time when analyzing the classification results in detail. 
[0019] Still further, when a neurocomputer is used for 
the classification logic in the particle classification and 55 
examination device, an alternation of the characteristic 
parameters for the neuro calculation can be easily 
achieved as well as the preparation of learning data and 



relearning can be performed only within the particle 
classification and examination device, which improves 
the classification accuracy at every operation time 
thereof. 

[0020] A plurality of characteristics of respective par- 
ticles picked out in the characteristic picking out unit are 
fed to the type identifying unit. The type identifying unit 
estimatedly determines types of the particles based on 
a plurality of the fed characteristics. With regard to par- 
ticles of which type can not be estimatedly determined 
by the type identifying unit, the images thereof are 
stored in the storage unit. Then, the stored images are 
displayed by the display unit and the displayed contents 
are examined by a user such as an examination engi- 
neer and the types of the particles are determined by 
the user. 

Brief Description of the Drawings 
[0021] 

Fig.1 is a block diagram illustrating a constitution of 
a particle classification device of one embodiment 
according to the present invention ; 
Fig.2 is a network diagram of a neurocomputer used 
in the particle classification device of the embodi- 
ment as shown in Fig.1 ; 

Fig.3 is an explanatory view of a displayed screen 
image in the particle classification device of the em- 
bodiment as shown in Fig.1 ; 
Fig.4 is an explanatory view of another displayed 
screen image in the particle classification device of 
the embodiment as shown in Fig.1 ; 
Fig.5 is a flowchart illustrating a correction se- 
quence of an automatic classification result in the 
particle classification device of the embodiment as 
shown in Fig.1 ; 

Fig. 6 is an explanatory view of a displayed screen 
image of a subclassif ication of an automatic classi- 
fication result in the particle classification device of 
the embodiment as shown in Fig.1 ; 
Fig.7 is a block diagram of a neurocomputer used 
in the particle classification device of the embodi- 
ment as shown in Fig.1 ; 

Fig. 8 is a flowchart illustrating a learning sequence 
of the neurocomputer in the particle classification 
device of the embodiment as shown in Fig.1 ; 
Fig.9 is a schematic constitutional diagram of an- 
other embodiment according to the present 
invention ; 

Fig.1 0 is an operation flowchart in the embodiment 
as shown in Fig.9 ; 

Fig. 11 is an operation flowchart in the embodiment 
as shown in Fig.9 when stored images are read out ; 
Fig. 12 is a view illustrating an example of displayed 
screen images ; 

Fig. 13 is an operation flowchart of a further embod- 
iment according of the present invention ; 
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Fig. 14 is an operation flowchart in the second em- 
bodiment as shown in Fig. 13 when stored images 
are read out ; and 

Fig. 15 is a schematic constitution diagram of a still 
further embodiment according to the present inven- 
tion. 

Detailed Description of the Embodiments 

[0022] Hereinbelow, an embodiment according to the 
present invention is explained with reference to Fig.1 
through Fig.B. 

[0023] The particle classification device of one em- 
bodiment according to the present invention which is ap- 
plied for classifying sediment components in urine is ex- 
plained with reference to Fig.1 . 

[0024] A sample urine 23 containing sediment com- 
ponent particles in urine to be examined flows down in 
a flow cell 1 while being surrounded by a sheath flow 24. 
[0025] The sample urine 23 and the sheath flow 24 
are fed into the flow cell 1 by a fluid pump (not shown) 
of which control is performed by a CPU 11 . 
[0026] Sediment component particles 22 in the sam- 
ple urine 23 are controlled to flow through the flow cell 
1 substantially at the center of the flowing down fluid by 
the sheath flow 24. 

[0027] The sediment component particles 22 in urine 
in the flow cell 1 are illuminated by a pulse like flash light 
from a flash lamp 2 and then converted into electrical 
image signals via a CCD camera 3. 
[0028] The converted colored particle image signals 
are further converted into digital signals via an A/D con- 
verted. The digital signals are sent to a binarizing circuit 
5 and at the same time sent to an image memory 9 
where the digital signals are stored. 
[0029] The binarizing circuit 5 discriminates the input- 
ted digital image signals according to their color stand- 
ard and converts into a plurality of binary image signals. 
Since there can exist a plurality of sediment component 
particle images in the binary image signals, the sedi- 
ment component images are then subjected to a so 
called labelling operation, in other words, corresponding 
numbers are assigned thereto via a subsequent label- 
ling circuit 6. 

[0030] From the respective labelled sediment compo- 
nent images characteristic quantities such as area, cir- 
cumferential length and average concentrations of re- 
spective red, green and blue colors of every sediment 
component image are picked out via a characteristic 
picking out circuit 7. 

[0031] The picked out characteristic quantities of the 
respective particles are inputted into a particle classifi- 
cation and identification circuit 8 and the respective sed- 
iment components are classified and identified. 
[0032] The binarizing circuit 5, the labelling circuit 6, 
the characteristic picking out circuit 7, the particle clas- 
sification and identification circuit 8 are provided respec- 
tively in three sets for covering respective colors of red, 



green and blue, and are controlled by the CPU 1 1 to 
which such as a memory 12, a floppy disk drive 13, a 
magneto-optic disk 14, an image display circuit 15, a 
printer 1 6 and a key board 1 7 are connected via a CPU 
5 bus 21 . To the image display circuit 1 5 is connected an 
image display use CRT 20 to which a touch panel 26 is 
attached. 

[0033] The touch panel 26 is designed to allow inputs 
by a user operator in an interactive manner with the CRT 

10 20 through a touch panel control circuit 25. 

[0034] Further, the CPU 11 is also designed to allow 
a telecommunication with an external computer 1 9 via 
a telecommunication circuit 18 such that such as the 
classification results and an abnormality of the present 

15 device can be communicated to the external computer 
19. 

[0035] In the present embodiment, an example of us- 
ing a neurocomputer for the particle identification is ex- 
plained. Fig.2 shows a neurocomputer network for par- 
20 tide identification used in the particle classification de- 
vice of the embodiment in Fig.1 . 

[0036] The neurocomputer used in the present em- 
bodiment is a Rumelhart type having a three layer struc- 
ture. 

25 [0037] The inputs for the neurocomputer are charac- 
teristic parameters such as area and circumferential 
length of the particle images, and the outputs thereof 
are types of the particles such as erythrocyte, leucocyte, 
epithelial cell, cast and microbe. Through increasing the 

30 node number in the network, further finer classification 
can be realized, for example the casts can be subclas- 
sif ied into such as glassy cast, granular cast, erythrocyte 
cast and epithelial cast. An output having the maximum 
value among the output values from the neurocomputer 

35 is determined as the classification result. 

[0038] The classification result and the colored parti- 
cle image digital signals stored in the image memory 9 
are recorded on the magneto-optic disk 14 as a single 
file. 

40 [0039] Since the neurocomputer is used for classifi- 
cation and learning with respect to the particles, output 
values for the respective classification items or types are 
in addition filed. At the same time, the results are dis- 
played on the CRT in addition to the colored particle im- 

^5 ages. Such display can be performed for every particle 
according to the measurement order or alternatively can 
be performed collective! ly after completing classification 
for one patient specimen. 

[0040] Further, Fig.3 is a displayed screen image in 
50 the particle classification device of the embodiment as 
shown in Fig.1 displaying at the same time particle im- 
ages and the automatic classification results thereon. In 
the respective frames in the drawing the particle images 
and the corresponding automatic classification results 
55 are displayed at one-to-one correspondance. 

[0041] Fig.4 is a displayed screen image in the parti- 
cle classification device of the embodiment as shown in 
Fig.1 displaying particle images classified in a same 
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classification item. 

[0042] These results can be outputted through the 
printer 16 and at the same time can be transferred to 
the external computer 1 9 via the telecommunication cir- 
cuit 18. 

[0043] The above series of operations for the particle 
image automatic classification is controlled by the CPU 
1 1 and of which control program is inputted in a floppy 
disk and is executed after loading the same into a mem- 
ory. Further, the manipulation thereof is performed via 
an input from the key board 17. 

[0044] Still further, the touch panel 26 is provided in 
the present embodiment, the inputting can be performed 
via the touch panel 26. 

[0045] For example, when a further subclassification 
is required, or when a correction of the automatic clas- 
sification results is required, a user operator can sub- 
classify or correct the automatic classification results 
while examining the images after the automatic and pro- 
visional classification is completed. 
[0046] The correction sequence of the automatic clas- 
sification results in the particle classification device of 
the embodiment as shown in Fig.1 is explained with ref- 
erence to the flowchart as shown in Fig.5. 
[0047] In the following, an example, wherein entire 
classification data are taken in for every one patient 
specimen, thereafter the automatic classification results 
are collectively displayed for every classification item 
and then a user operator inputs subclassification and 
correction data via the touch panel 26, is explained. 
[0048] Step S1 through step S7 show the respective 
sequences. In step S1 through step S3 particle images 
of the respective particles of one patient specimen are 
taken in and the automatic classification is performed 
thereon. 

[0049] tn step S1 , one particle image of the patient 
specimen is taken in via the CCD camera 3, the bina- 
rized characteristics are picked out therefrom, and the 
automatic classification is performed thereon via the 
neurocomputer 8. 

[0050] Subsequently, in step S2 the classification re- 
sults and the image data obtained at step S1 are stored 
in the magneto optic disk 14 and filed. 
[0051] In step S3, a checking whether all of the data 
collection for the patient specimen is completed, if not 
completed, the process returns to step S1 , and if com- 
pleted, the process advances to the subsequent step 
S4. 

[0052] Step S4 through step S7 show sequences 
wherein the user operator performs subclassification or 
the correction on the results obtained during the auto- 
matic classification. 

[0053] In step S4, the colored particle image data as- 
sociated with the automatic classification results stored 
in the magneto optic disk are displayed on the CRT dis- 
play 20 for every classification item. 
[0054] In the subsequent step S5, the user operator 
checks whether the automatic classification results are 



to be corrected based on the displayed particle images, 
if it is determined a correction thereof is necessary, the 
user operator causes to move the process to step S6, 
and if determined a correction thereof is unnecessary, 

s the user operator causes to move the process to step 
S7. When the user operator inputs an input indicative of 
correction necessity in step S5, the user operator inputs 
a correction data which is determined by himself in the 
subsequent step S6 and then causes to move the proc- 

10 ess to step S7. 

[0055] In step S7 to which the process moves from 
both step S5 and step S6, a checking whether reviewing 
of all of the data is completed is performed. When the 
user operator reviews all of the data and completes nec- 

15 essary corrections, it is determined that the process for 
one patient specimen has been completed, then the 
process goes END. 

[0056] When correction for all of the data has not been 
completed, the process returns again to step S4, and 

20 step S5 through S7 are repeated. 

[0057] A subclassification of the automatic classifica- 
tion results in the particle classification device of the em- 
bodiment as shown in Fig.1 is explained with reference 
to Fig. 6. In the present example, sediment components 

25 classified as casts via the automatic classification unit 
are collectively displayed and these casts are classified 
and identified, for example, as glassy cast and granular 
cast. 

[0058] The input operation for the above subclassifi- 
30 cation is performed in the following manner. At first, an 
image on the screen of which classification is desired is 
touched. Through this touching an image selection sig- 
nal is inputted in the touch panel 26 and the image is 
selected. 

35 [0059] Then, a classification item at the bottom of the 
screen is determined by the user operator viewing the 
selected image and is touched. Thereby, a subclassifi- 
cation is determined and inputted. The above operation 
is performed for all of the necessary images. 

40 [0060] When images to be classified are exhausted, 
one of "subsequent specimen" or "end" on the screen 
is touched. Through these sequences the subclassifica- 
tion and the correction are performed. 
[0061 ] Now, the neurocomputer for identification used 

^5 in the present embodiment is explained. Fig.7 shows a 
block diagram when a neurocomputer is used for the 
particle identification unit 8 in the particle classification 
device of the embodiment as shown in Fig.1 , in which 
the elements bearing the same reference numerals as 

50 in Fig.1 designate the same or equivalent elements as 
in Fig.1 and the explanation thereof is omitted. 
[0062] In Fig.7, the neurocomputer 8 is constituted by 
such as a characteristic parameter input memory 27, a 
digital signal processing processor 28, a program mem- 

55 ory 29, a neuro calculation parameter memory 30 and 
an inter CPU telecommunication circuit 31 which are 
connected each other via a digital signal processing 
processor bus 32. 
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[0063] In like manner, the program memory 29, the 
neuro calculation parameter memory 30 and the inter 
CPU telecommunication circuit 31 are connected to the 
CPU 11 (not shown in Fig.7) via the CPU bus 21 . 
[0064] A neuro calculation is performed in the digital s 
signal processing processor 28. The programs for the 
neuro calculation are loaded into the program memory 
29 from the CPU 1 1 via the CPU bus 21 , and parameters 
for the neuro calculation are loaded into the neuro cal- 
culation parameter memory 30 from the CPU 1 1 via the 
CPU bus 21. 

[0065] The characteristic parameters necessary for 
the above calculation are provided from the character- 
istic picking-out circuit 7 via the characteristic parameter 
input memory 27 and the calculation results are trans- 
ferred to the inter CPU telecommunication circuit 31 . 
[0066] The values at the output layer in the network 
of the neurocomputer as shown in Fig. 2 are transmitted 
to the CPU 11 , and at the same time a particle identifi- 
cation result determined based on the output exhibiting 
the maximum value is also transmitted. 
[0067] In the present embodiment, the parameters for 
the neuro calculation are designed to be rewritable, the 
classification logic can be altered by rewriting the neuro 
calculation parameters stored in the floppy disk. 
[0068] Now, a neuro learning in the particle classifica- 
tion device of the present embodiment is explained. For 
the first time, measurement of sample urine is per- 
formed in the same manner as in the classification ex- 
plained above. Then, a user operator reclassifies the re- 
sult, adds the reclassified results into learning data 
which have been accumulated from the past as addi- 
tional learning data and renews the learning data. 
[0069] Fig. 8 is a flowchart illustrating a learning se- 
quence of the neurocomputer in the particle classifica- 
tion device of the embodiment as shown in Fig.1 . 
[0070] Step S11 through step S15 show the above 
learning sequence. At first, in step S1 1 , a data collection 
and an automatic classification for one patient specimen 
and filing of the classification results and image data are 
performed. 

[0071] The sequence in step S11 is identical to that in 
step S1 through step S3 relating to the correction se- 
quence of the automatic classification results as ex- 
plained in connection with Fig.5, and further the se- 
quence in step S1 2 is identical to that in step S4 through 
step S7 as explained in connection with Fig.5, the de- 
tailed explanation thereof is omitted for avoiding dupli- 
cation and complexing. 

[0072] In step S13, the classification result conected 
by the user operator at step S12 is added to the neuro 
learning data contained in the particle classification de- 
vice itself to make a teacher data for the learning and to 
form a new neuro learning data. 

[0073] In step S14, a learning of the neurocomputer 
is performed based on the new neuro learning data by 
making use of a so called back propagation method. 
[0074] In step S15, calculation parameters such as 



neurocomputer weighting parameter obtained in the 
learning at step S14 can be rewritten and renewed. 
[0075] Through the sequences as explained above, a 
relearning of the neurocomputer is performed and the 
amount of the accumulated data is increased through 
which an improvement of classification accuracy is 
greatly expected. 

[0076] In the present embodiment, classification of 
sediment components in urine is explained. However, 
with the particle classification device according to the 
present embodiment a corpuscle classification can like- 
ly be performed by modifying the binarized threshold 
values and the neuro calculation parameters suitable for 
the corpuscle classification in blood. 
[0077] According to the present embodiment, as ex- 
plained in detail in the above, a particle classification 
and examination device is provided which picks out 
characteristic parameters of the respective particles and 
automatically and provisionally determines the classifi- 
cation of the respective particles to thereby eliminate 
man-hour for the particle classification, stores and dis- 
plays the classification results and the particle images 
altogether and permits alternation of the characteristic 
parameters and preparation of learning data and re- 
learning to thereby improve time to time the classifica- 
tion accuracy. 

[0078] Hereinbelow, further embodiments of the 
present invention are explained with reference to Fig. 9 
through Fig. 15. 

[0079] Fig. 9 is a schematic constitutional diagram of 
another embodiment of the classification and examina- 
tion devices of particles in fluid according to the present 
invention which is applied to classification and a exam- 
ination device for urine sediments. 
[0080] In Fig. 9, light generated from a flash lamp 51 
constituting a light source for a microscope advances 
along an optic axis of the microscope, passes through 
a field lens 52, is restricted by a field stop 61 and an 
aperture stop 62 and forms a light souce flux 60. Then 
the light flux 60 is condensed via a condensor lens 53 
onto a sample 63 flowing within a flow cell 54. 
[0081] A particle image of the sample 63 is formed at 
an imaging position 56 by an objective lens 55 of the 
microscope. The particle image at the imaging position 
56 is projected on the image picking up plane of a TV 
camera 58 via a projection lens 57 and subjected here 
to photo-electric conversion. For the TV camera 58, for 
example, a CCD (Charge Coupled Device) type TV 
camera having a limited after image is used. Further, 
since the diameter of objects for the urine sediment ex- 
amination varies from less than 1um to 200 pm which 
requires a broad measurement range so that the pro- 
jection magnification of the TV camera 58 is designed 
to be switched by the projection lens 57 depending on 
necessity. 

[0082] Image signals from the TV camera 58 are sup- 
plied to an image memory 75 via an A/D converter 74 
as well as to an image processing control unit 76. The 
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image processing control unit 76 executes controls of 
such as image writing and image processing for the im- 
age memory 75. 

[0083] Image signals outputted from the image mem- 
ory 75 are supplied to a characteristic picking out unit 
78 and there a plurality of characteristics of the particles 
concerned are picked out. Namely, via the characteristic 
picking out unit 78 primary parameters of the sediment 
components such as shape, color and size are picked 
out. The characteristic picking out unit 78 supplies to a 
classification unit or an identification unit 79 the primary 
parameters and secondary parameters which are gen- 
erated through combined calculations of the primary pa- 
rameters. 

[0084] The classification unit 79 uses a Rumelhart 
type neural network and performs classification of the 
sediment components. The neural network has per- 
formed in advance learning by making use of a great 
many of data checked by experts and coupling coeffi- 
cients between respective neurons are optimized. Ac- 
cordingly, the classification unit 79 performs a neural 
network calculation by making use of inputted parame- 
ters and can execute automatic classification of the ob- 
jective sediment components. 

[0085] The classification results executed by the clas- 
sification unit 79 are supplied to a central control unit 
80. Then, a storage necessity judging unit 801 included 
in the central control unit 80 judges whether or not the 
classified components are to be stored in a form of im- 
ages according to a predetermined condition and when 
judged it is necessary to store the images, the images 
are stored in an image storage unit 81 . The central con- 
trol unit 80 also performs such as signal transmission 
and reception with the image processing control unit 76, 
issues image display commands to a display 82 and re- 
ceives command signals from a key board 83. Since 
there are diversified types of urine sediment compo- 
nents, it is sometimes impossible to classify all of the 
sediment components automatically and in some in- 
stances inclassifiable sediment components may ap- 
pear. Therefore, the images of the inclassifiable urine 
sediment components are stored in the image storage 
unit 81. 

[0086] Now, detection of passing particles in the flow 
cell 54 is explained. 

[0087] A semiconductor laser 65 is always lighted, the 
light flux from the semiconductor laser 65 is converted 
into parallel light flux via a collimator lens 67, and a sin- 
gle direction of the light flux is focused via a cylindrical 
lens 68. The light flux from the cylindrical lens 68 is re- 
flected via a reflection mirror 69 and a micro reflection 
mirror 64 and is focused at a laser focusing position on 
the sample 63 in the flow cell 54. Then, the laser beam 
is reflected via a beam splitter 70 and is supplied to a 
photo detector 72 via a stop 71 . Signals from the photo 
detector 72 are supplied to a lighting control unit 73. 
[0088] When sediment components of the measure- 
ment object pass through the laser beam in the flow cell 



54, the laser beam is scattered. When a level of particle 
detection signal of the scattered light exceeds a prede- 
termined level, the lighting control unit 73 judges that 
particles of image processing object are passing 

5 through a predetermined position , and when the particle 
reaches to another predetermined position in an image 
picking up region for the TV camera 58, the lighting con- 
trol unit 73 controls a lamp drive circuit 77 so as to light 
the flash lamp 51 . 

10 [0089] The lighting period of the flash lamp 51 is set 
so short that the movement of a particle in the flow of 
the sample 63 is negligible. For this reason, when the 
flash lamp 51 is lighted, the video output signals of the 
TV camera 58 can pick up sediment components in the 

is flow of sample 63 as still images. 

[0090] Fig. 10 is a flowchart for explaining the opera- 
tion of the embodiment as shown in Fig. 9. 
[0091] In step 100 in Fig. 10, when a particle in the 
sample 63 is detected by the lighting control unit 73, the 

20 flash lamp 51 is lighted in step 101 . Then, in step 102 
an image is taken in via the TV camera 58, A/D converter 
74 and image memory 75, and is supplied to the char- 
acteristic picking out unit 78. Thereafter, in step 1 03 the 
characteristic picking out unit 78 picks out characteris- 
es tics of the particle from the taken in image. 

[0092] Then, in step 104 the classification unit 79 clas- 
sifies the particle. Subsequently, in step 1 05 the storage 
necessity judging unit 801 in the central control unit 80 
judges whether the classification result corresponds to 

30 designated cells. When it is judged in step 1 05 that the 
classification result corresponds to one of the designat- 
ed cells or is indiscernible, the process proceeds to step 
106. In step 106, the central control unit 80 takes out 
the particle image stored in the image memory 75 via 

35 the image processing control unit 76 and the identifica- 
tion result and the particle image are stored in the image 
storage unit 81 . In case when the particle is inidentifia- 
ble, the classification information determined in the clas- 
sification unit 79 is stored together with the particle im- 

40 age in the image storage unit 81 . Then the process pro- 
ceeds to step 1 07. Further, when it is judged in step 1 05 
that the classification result is discernible but not corre- 
sponds to one of the designated cells, the process also 
proceeds to step 107. Then, in step 107 completion of 

45 the classification is judged, if not completed the process 
returns to step 100 and the steps 100 through 105 or 
steps 1 00 through 1 06 are repeated, and further if com- 
pleted the process ends. Further, the cell designation in 
step 105 is inputted beforehand into the central control 

50 unit 80 via the key board 83 such as by a user operator. 
Still further, when it is judged in step 105 that the clas- 
sification result corresponds to non-designated cell, the 
name of the cell can be displayed on the display 82. 
[0093] Fig. 11 is a flowchart for explaining operation in 

55 step 106 in Fig. 10 when such as an examination engi- 
neer reviews and judges the stored images. 
[0094] In step 200 in Fig.1 1 , the examination engineer 
commands to the central control unit 80 via the key 
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board 83 to display the images stored in the image stor- 
age unit 81 on the display 82 during examination or any 
time after completing the examination. In response to 
the command, the central control unit 80 takes out de- 
termined results as well as the images of the sediment 
components from the image storage unit 81 and dis- 
plays the same on the image display 82. Fig. 12 shows 
an example of displayed screen image. In the example 
of Fig. 12, eight flat epithelials among many detected 
particles are displayed and in addition detected num- 
bers of such as leucocytes and erythrocytes are dis- 
played. Two ordered ways of display can be selected, 
one according to classification category or item and the 
other according to apperaring order of the particles in 
the flow cell. Subsequently, in step 201 the examination 
engineer reviews the determined results and the images 
displayed on the display 82 and judges whether the de- 
termined results are correct. When it is judged the de- 
termined results are incorrect the process proceeds to 
step 202 and the results are corrected through manipu- 
lation of the key board 83 by the examination engineer, 
and has the classification unit 79 learn the newly deter- 
mined results. Through this operation the classification 
capability of the classification unit 79 is improved. Then, 
the process proceeds to step 203. Further, when the de- 
termined results are judged correct in step 201 , the proc- 
ess also proceeds to step 203. In step 203, it is judged 
whether the images to be read out are exhausted, if not 
exhausted the process returns to step 200 and repeats 
the steps 200 through 203, and further if exhausted, the 
process ends. 

[0095] In the present embodiment according to the 
present invention as explained above, the types of the 
detected particles in urine are comprehensively evalu- 
ated through a neural network in the classification unit 
79. Further, with regard to indiscernible particles their 
images and classification information are stored in the 
image storage unit 81 and the determined results as in- 
discernible are reviewed and corrected by a user such 
as an examination engineer and the corrected informa- 
tion is supplied for learning to the classification unit 79. 
Accordingly, a urine particle classification and examina- 
tion device, which allows accurate and fast automatic 
component particle analysis even for urine of non-healty 
persons containing a variety of components in high con- 
centration, can be realized. Further, the image storage 
unit 81 requires no large capacity, because the image 
storage unit 81 is designed to store only the images of 
indiscernible particles and predetermined ones such as 
designated cells. 

[0096] Fig. 13 is a flowchart for explaining operation 
of a further embodiment according to the present inven- 
tion. Since the constitution of the device is substantially 
the same as that of the previous embodiment, the illus- 
tration thereof is omitted. However, in the present em- 
bodiment, the storage necessity judging unit 801 includ- 
ed in the central control unit 80 in the previous embod- 
iment is excluded. Namely, the image storage method 



of the present embodiment is different from that of the 
previous embodiment. In the previous embodiment only 
the particle images of the designated components and 
indiscernible ones are stored, however, the present em- 
5 bodiment is designed to store images of ail of the de- 
tected sediment components. 

[0097] In Fig. 1 3, step 1 00 through step 1 04 are iden- 
tical to those in Fig. 1 0. After executing the classification 
in step 104, the process proceeds to step 106 wherein 
the images of classified particles and the classification 
results are stored. Then the process proceeds to step 
107 wherein the classification completion is judged, if 
not completed the process returns to step 100, and if 
completed the process ends. 

[0098] Fig. 14 is a flowchart for explaining operations 
in step 106 in Fig. 13 when a user such as an examina- 
tion engineer reviews and judges the images and clas- 
sification results stored. 

[0099] In step 200A in Fig. 1 4, the classification results 
stored are read in. Then, in step 200B it is judged wheth- 
er the classification results correspond to the designat- 
ed cells or are indiscernible ones. In case when the clas- 
sification results neither correspond to the designated 
cells nor are indiscernible ones, the process proceeds 
to step 203. In case when it is determined in step 200B 
that the classification results either correspond to the 
designated cells or are indiscernible ones, the process 
proceeds to step 200C and the stored images are read 
in and displayed. Then it is judged in step 201 whether 
the classification results are correct, and if the results 
are correct, the process proceeds to step 203, and if the 
results are incorrect the process proceeds to step 202 
wherein the results are corrected and the corrected in- 
formation is transmitted to the classification unit 80 for 
learning. Thereafter, the process proceeds to step 203 
wherein it is judged whether the images are exhausted, 
and if not exhausted, the process returns to step 200 A 
and the steps 200A through 202 are repeated, and if 
exhausted the process ends. 

[0100] Like the previous embodiment, with the 
present embodiment according to the present invention, 
a urine particle classification and examination device, 
which allows accurate and fast automatic component 
particle analysis even for urine of non-healty persons 
containing a variety of components in high concentra- 
tion, can be realized. 

[01 01 ] Fig. 1 5 is a schematic constitutional diagram of 
a still further embodiment according to the present in- 
vention. The constitutions of the present embodiment 
other than that of the classification unit 79 are substan- 
tially the same as those in the embodiment as shown in 
Fig.9. Explanation of the same or equivalent portions 
thereof is omitted. 

[0102] In Fig. 15, the classification unit 79 performs 
classification of particles by making use of a plurality of 
the characteristic quantities picked out by the charac- 
teristic picking out unit 78. The classification unit 79 
forms a Rumelhart type neural network and is constitut- 
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ed by an input layer 791 , an intermediate layer 792 and 
an output layer 793. The number of nodes at the input 
layer 791 corresponds to the number of characteristic 
quantities or parameters and the number of nodes at the 
output layer 793 corresponds to the number of types or 
classification items of the particles to be identified. The 
number of nodes at the intermediate layer 792 are de- 
termined so as to fulfill both requirements for calculation 
time and for identification accuracy. 
[0103] Coupling coefficients between respective 
nodes in the neural network are optimized by making 
use of a great many characteristic quantities with certi- 
fied results. Namely, the coupling coefficients for all of 
the characteristic quantities with certified results are de- 
termined in advance in such a manner that when char- 
acteristic quantities are inputted at the input layer 791 
the output of a node at the output layer which corre- 
sponds to the identification result shows a maximum val- 
ue. 

[01 04] When identifying an unknown particle, charac- 
teristic quantities thereof are input in the input layer 791 , 
a neural network calculation is performed thereon and 
the node number of the output layer 793 providing the 
maximum value corresponds the identification result, 
and when the maximum value is over a predetermined 
slice level, the type corresponding to the outputting node 
number is determined as the identification result for the 
particle and when the maximum value is below the pre- 
determined slice level, an identification failure is judged. 
In case of such identification failure the classification 
unit 79 supplies a signal representing such identification 
failure to the central control unit 80. The central control 
unit 80 is provided with the storage necessity judging 
unit 801 and judges based on signals from the classifi- 
cation unit 79 whether the images are to be stored in the 
image storage unit 81 . 

[0105] As explained above, according to the present 
embodiment of the present invention, the types of the 
component particles detected in urine are comprehen- 
sively evaluated and identified via the neural network. 
Further, with regard to particles of identification failure, 
their images and classification information are stored in 
the image storage unit 81 , the types of the particles are 
identified by a user such as an examination engineer 
and the identification result is inputted, in that by provid- 
ing a correct result for the particle of identification failure 
into the neural network, an accuracy of the coupling co- 
efficients between nodes can be further improved. Ac- 
cordingly, like the embodiment in Fig. 9, a urine particle 
classification and examination device, which allows ac- 
curate and fast automatic component particle analysis 
even for urine of non-healty persons containing a variety 
of components in high concentration, can be realized. 
Further, the image storage unit 81 requires no large ca- 
pacity, because the image storage unit 81 is designed 
to store only the images of indiscernible particles and 
predetermined ones such as designated cells. 
[0106] Further, for the image storage unit 81 a mag- 



neto-optic disk having a large storage capacity and per- 
mitting erasing and rewritting can be used. 
[0107] Still further, sediment components, for exam- 
ple heteromorphic cell and cancer cell, of infrequent ap- 
s pearance but having a significant implication for clinical 
diagnosis can be stored in the image storage unit 81 
depending on necessity. 

[0108] Moreover, in the above embodiments the 
present invention is applied to a classification and ex- 

10 amination device of particles in urine, however, the ap- 
plication of the present invention is not limited to the 
above embodiments and the present invention is likely 
applicable to classification and examination device of 
particles in a variety of fluids. 

15 [0109] Further, the following advantages are in addi- 
tion obtained according to the present invention ; when 
such as an examination engineer performs review on 
component particles through the display, the engineer 
can perform the review at any time, a proper man-hour 

20 allocation in connection with the examination can be 
achieved. 

[0110] Still further, when only the particle images 
which could not be identified their types are designed to 
be stored, the following advantages are further 
25 obtained ; 

(1) A storage capacity of the storage unit which 
stores images is reduced. 

(2) The examination speed can be improved due to 
30 the reduction of the storage capacity of the image 

storage unit. 



1 . A classification and examination device of particles 
(22) in fluid having an image picking up unit (3; 58) 
which is arranged to pick up colored images of re- 
spective particles (22) dispersed in a specimen 

40 flowing in a flow cell (1 ; 54) and an image process- 
ing unit (4 - 9; 74, 75, 76, 78, 79), which is arranged 
to convert each of the colored particle images into 
at least one binary image signal based on a color 
standard, to calculate a plurality of characteristic 

45 quantities of the respective particles (22) based on 
the binary image signal, to automatically and provi- 
sionally classify the type of the respective particles 
(22) based on one of the calculated plurality of char- 
acteristic quantities and to display the colored par- 

50 tide images according to the classification, charac- 
terized In that 

said image processing unit (4 - 9; 74, 75, 76, 
78, 79) is arranged to automatically and provi- 
55 sionally classify the type of the respective par- 

ticles (22) based on a combination of the cal- 
culated plurality of characteristic quantities and 
displays the colored particle images together 
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with the automatic and provisional type classi- 
fication results in a manner grouped according 
to a predetermined order of classification types; 
and 

the device further comprises a neurocomputer 
(8) having learning capacity for permitting a us- 
er operator a reclassification through an input- 
ting means (1 7, 26; 83) based on the displayed 
colored particle images and the automatic and 
provisional type classification resutts thereof, 
which is optionally performed as a final classi- 
fication, if required. 

2. The device according to claim 1 , characterized in 
that said image processing unit (4 - 9; 74, 75, 76, 
78, 79) comprises means (14; 81) for storing both 
the colored particle images and the automatic and 
provisional type classification results thereof to- 
gether with related data of the specimen inputted 
by the user operator through said inputting means 
(17, 26; 83). 

3. The device according to any one of the preceding 
claims, characterized in that said image process- 
ing unit (4 - 9; 74, 75, 76, 78, 79) comprises means 
(80) for arranging the colored particle images asso- 
ciated with the automatic and provisional type clas- 
sification results thereof according to a predeter- 
mined order of classification types and displaying 
the arrangement on a screen (82). 

4. The device according to any one of the preceding 
claims, characterized in that the automatic and 
provisional type classification is performed on a 
neural network logic. 

5. The device according to any one of the preceding 
claims, characterized in that the specimen is urine 
and the particles (22) to be classified are sediments 
in the urine. 



PatentansprOche 

1. Eine Klassifizier- und Prufvorrichtung fur Teilchen 
(22) in einem Fluid mit einer Bildaufnahmeeinheit 
(3; 58), die ausgestaltet ist, urn farbige Bilder jewei- 
liger Teilchen (22) aufzunehmen, die in einer Probe 
zerstreut sind, flieBend in einer FluBzelle (1; 54), 
und mit einer Bildverarbeitungseinheit (4 - 9; 74, 75, 
76, 78, 79), die ausgestaltet ist, um jedes der farbi- 
gen Teilchenbilder in zumindest ein binares Bildsi- 
gnal umzuwandeln, basierend auf einem Farbstan- 
dard, um eine Mehrzahl charakteristischer Mengen 
der jeweiligen Teilchen (22) zu berechnen, basie- 
rend auf dem binaren Bildsignal, um automatisch 
und vorlaufig den Typ der jeweiligen Teilchen (22) 
zu klassifizieren, basierend auf einer der berechne- 



ten Mehrzahl charakteristischer Mengen, und um 
die farbigen Teilchenbilder entsprechend der Klas- 
sifizierung anzuzeigen, dadurch gekennzeichnet, 
daB 

5 

die Bildverarbeitungseinheit (4 - 9; 74, 75, 76, 
78, 79) ausgestaltet ist, den Typ der jeweiligen 
Teilchen (22) automatisch und vorlaufig zu 
klassifizieren, basierend auf einer Kombination 

10 der berechneten Mehrzahl charakteristischer 

Mengen, und die farbigen Teilchenbilder zu- 
sammen mit den automatischen und vorlaufi- 
gen Typ-Klassifizierungsergebnissen darstellt, 
auf eine Weise gemaB einer vorbestimmten 

15 Ordnung von Klassifizierungstypen gruppiert; 

und 

die Vorrichtung desweiteren einen Neurocom- 
puter (8) mit einer Lernfahigkeit aufweist, um 
einem Benutzer-Bediener eine Reklassifizie- 

20 rung durch eine Eingabeeinrichtung (17, 26; 

83) zu ermdglichen, basierend auf den ange- 
zeigten farbigen Teilchenbildern und den auto- 
matischen und vorlaufigen Typ-Klassifizie- 
rungsergebnissen davon, was, falls erforder- 

25 Hch , optional als eine endgultige Klassifizie rung 

durchgefuhrt ist. 

2. Die Vorrichtung nach Anspruch 1, dadurch ge- 
kennzeichnet, daB die Bildverarbeitungseinheit (4 

30 - 9; 74, 75, 76, 78, 79) Mittel (14; 81) aufweist zum 

Speichem sowohl der farbigen Teilchenbilder als 
auch der automatischen und vorlaufigen Typ-Klas- 
sifizierungsergebnisse davon zusammen mit damit 
verbundenen Daten der Probe, eingegeben durch 

35 den Benutzer-Bediener durch das Eingabemittel 
(17, 26; 83). 

3. Die Vorrichtung nach einem der vorhergehenden 
Anspruche, dadurch gekennzeichnet, daB die 

40 Bildverarbeitungseinheit (4 - 9; 74, 75, 76, 78, 79) 
Mittel (80) aufweist zum Ordnen der farbigen Teil- 
chenbilder, zugeordnetden automatischen und vor- 
laufigen Typ-Klassifizierungsergebnissen davon 
entsprechend einer vorbestimmten Ordnung von 

45 Klassifizierungstypen und zum Anzeigen der An- 
ordnung auf einem Bildschirm (82). 

4. Die Vorrichtung gemaB irgendeinem der vorherge- 
henden Anspruche, dadurch gekennzeichnet, 

so daB die automatische und vorlaufige Typ-Klassffi- 
zierung auf einer neuralen Netzwerklogik durchge- 
fuhrt wird. 

5. Die Vorrichtung gemaB irgendeinem der vorherge- 
55 henden Anspruche, dadurch gekennzeichnet, 

daB die Probe Urin ist und die zu klassifizierenden 
Teilchen (22) Sedimente in dem Urin sind. 
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Revend (cations 

1 . Dispositif de classification et d'examen de particu- 
les (22) dans un fluide, ayant une unite de prise 
d'images (3 ; 58) qui est concue pour prendre des 5 
images colorees de particules respectives (22) dis- 4. 
persees dans un echantillon s'ecoulant dans une 
cellule d'ecoulement (1 ; 54) et une unite de traite- 

ment d'images (4-9 ; 74, 75, 76, 78, 79), qui est con- 
cue pour convertir chacune des images de particu- 10 
les colorees en au moins un signal d'image binaire 5. 
sur la base d'une norme de couleur, pour calculer 
une pluralite de quantites caracteristiques des par- 
ticules respectives (22) sur la base du signal d'ima- 
ge binaire, pour classifier automatiquement et pro- *5 
visoirement le type des particules respectives (22) 
sur la base d'une quantity parmi la pluralite calculee 
de quantites caracteristiques et pour afftcher tes 
images de particules colorees conformement a la 
classification, caracterise en ce que 20 

ladite unite de traitement d'images (4-9 ; 74, 75, 
76, 78, 79) est concue pour classifier automa- 
tiquement et provisoirement le type des parti- 
cules respectives (22) sur la base d'une com- 25 
binaison de la pluralite calculee de quantites 
caracteristiques et affiche les images de parti- 
cules colorees ensemble avec les resultats de 
classification de types automatique et provisoi- 
re d'une maniere groupee conformement a un 30 
ordre predetermine de types de classification, 
et 

le dispositif comporte de plus un ordinateur 
neuronal (8) ayant une capacite d'apprentissa- 
ge pour permettre a un operateur-utilisateur 35 
d'effectuer une reclassification par I'interm6- 
diaire de moyens d'entree (17, 26 ; 83) sur la 
base des images de particules colorees affi- 
che es et des resultats de classification de types 
automatique et provisoire de celles-ci, qui est 40 
effectu§e de maniere facultative en tant que 
classification finale si necessaire, 

2. Dispositif selon la revendication 1 , caracterise en 

ce que ladite unite de traitement d'images (4-9 ; 74, 45 
75, 76, 78, 79) comporte des moyens (1 4 ; 81 ) pour 
m6moriser a la fois les images de particules colo- 
rees et les resultats de classification de types auto- 
matique et provisoire de celles-ci ensemble avec 
des donnees associees de I* echantillon entries par so 
I'operateur-utilisateur a travers lesdits moyens 
d'entree (17, 26; 83). 

3. Dispositif selon I'une queiconque des revendica- 
tions precedentes, caracterise en ce que ladite 55 
unite de traitement d'images (4-9 ; 74, 75, 76, 78, 

79) comporte des moyens (80) pour agencer les 
images de particules colorees associees aux resul- 



tats de classification de types automatique et pro- 
visoire de celles-ci conformement a un ordre pre- 
determine de types de classification et pour afficher 
I'agencement sur un ecran (82). 

Dispositif selon Tune queiconque des revendica- 
tions precedentes, caracterise en ce que la clas- 
sification de types automatique et provisoire est ef- 
fectuee sur une logique de reseau neuronal. 

Dispositif selon I'une queiconque des revendica- 
tions precedentes, caracterise en ce que Pechan- 
tillon est de I'urine et les particules (22) a classifier 
sont des sediments dans I'urine. 
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FIG. 7 
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